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Abstract — In this paper asymptotic methods are used to form 
lower bounds on the free distance to constraint length ratio of 
several ensembles of regular, asymptotically good, protograph- 
based LDPC convolutional codes. In particular, we show that 
the free distance to constraint length ratio of the regular LDPC 
convolutional codes exceeds that of the minimum distance to 
block length ratio of the corresponding LDPC block codes. 

L Introduction 

LDPC convolutional codes, the convolutional counterparts 
of LDPC block codes, were introduced in [1], and they have 
been shown to have certain advantages compared to LDPC 
block codes of the same complexity [2], [3]. In this paper, 
we use ensembles of (J, K) regular tail-biting LDPC convo- 
lutional codes derived from a protograph-based ensemble of 
LDPC block codes to obtain a lower bound on the free distance 
to constraint length ratio of unterminated, asymptotically good, 
periodically time-varying regular LDPC convolutional code 
ensembles, i.e., ensembles that have the property of free 
distance growing linearly with constraint length. 

In the process, we show that the minimum distances of 
ensembles of tail-biting LDPC convolutional codes (intro- 
duced in [4]) approach the free distance of an associated 
unterminated, periodically time-varying LDPC convolutional 
code ensemble as the block length of the tail-biting ensem- 
ble increases. We show that, for rate 1/2 protograph-based 
ensembles with regular degree distributions, the free distance 
bounds are consistent with those recently derived for more 
general regular LDPC convolutional code ensembles in [5] 
and [6] . Further, the relatively low complexity requirements of 
computing the bound allows us to calculate new free distance 
bounds that grow linearly with constraint length for values 
of J and K that have not been previously considered in 
the literature. We show, for all the ( J,K)-regular ensembles 
considered, that the free distance to constraint length ratio 
exceeds the minimum distance to block length ratio of the 
corresponding block codes. 

The paper is structured as follows. In Section HIl we briefly 
introduce LDPC convolutional codes. Section [IIIl summarizes 
the technique proposed by Divsalar to analyze the asymptotic 
distance growth behavior of protograph-based LDPC block 
codes [7]. In Section |lVl we discuss methods of forming 
regular convolutional codes from regular protographs. We then 
describe the construction of tail-biting LDPC convolutional 



codes as well as corresponding unterminated, periodically 
time-varying LDPC convolutional codes in Section (V] In 
addition, we show that the free distance of a periodically time- 
varying LDPC convolutional code is lower bounded by the 
minimum distance of the block code formed by terminating it 
as a tail-biting LDPC convolutional code. Finally, in Section 
IVllwe present lower bounds on the free distance of ensembles 
of regular LDPC convolutional codes based on protographs. 

II. LDPC CONVOLUTIONAL CODES 

We start with a brief definition of a rate R = b/c binary 
LDPC convolutional code C. (A more detailed description can 
be found in [1].) A code sequence V[o,oo] satisfies the equation 



where Uj^^^^ 

H[o,oo] = 
Ho(0) 
Hi(l) 



V[0,oo]H[o^^] - 0, 

is the syndrome former matrix and 



(1) 



Ho(l) 



H^,(ms) 



H^,-i(ms) 
H^,(m,, + 1) 



_i(ms + 1) 



Ho(ms) 



Ho(ms + l) 



is the parity-check matrix of the convolutional code C. The 
submatrices Hi(t), i = 0, l,---,ms, t > 0, are binary 
{c — b) X c submatrices, given by 
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that satisfy the following properties: 

1) Hi(t) =0, i < and i > m^, V t. 

2) There is a t such that H^^(t) ^ 0. 

3) Ho(t) ^ and has fufl rank V t. 

We call ms the syndrome former memory and v^ = (mg + 1) • c 
the decoding constraint length. These parameters determine 
the width of the nonzero diagonal region of H[o,cx)]- The 
sparsity of the parity-check matrix is ensured by demanding 
that its rows have very low Hamming weight, i.e., WH{h.i) « 
(ms + l)-c, i > 0, where h^ denotes the i-th row of 
H[o,oo]- The code is said to be regular if its parity-check 
matrix H[o,cx)] has exactly J ones in every column and, starting 



from row (c — 6)ms + 1, K ones in every row. The other 
entries are zeros. We refer to a code with these properties 
as an (mg, J, i^) -regular LDPC convolutional code, and we 
note that, in general, the code is time-varying and has rate 
R = 1 — J/K. A rate R = b/c, (mg, J, iiT) -regular time- 
varying LDPC convolutional code is periodic with period cT 
if B.i{t) is periodic, i.e., Hi(t) = Hi(t + T), V i, t, and if 
Hi(t) = H^,V i,t, the code is time-invariant. 

III. Protograph Weight Enumerators 

Suppose a given protograph has Uy variable nodes and ric 
check nodes. An ensemble of protograph-based LDPC block 
codes can be created using the copy-and-permute operation 
[8]. The Tanner graph obtained for one member of an ensemble 
created with this method is illustrated in Fig. [T] 




Fig. 1. The copy-and-permute operation for a protograph. 

The parity-check matrix H corresponding to the ensemble 
of protograph-based LDPC block codes can be obtained by 
replacing ones with N x N permutation matrices and zeros 
with N X N Sill zero matrices in the underlying protograph 
parity-check matrix P, where the permutation matrices are 
chosen randomly and independently. The protograph parity- 
check matrix P corresponding to the protograph given in 
Figure [T] can be written as 
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rate and degree distribution for each of its variable and check 
nodes as the underlying protograph code. 

Combinatorial methods of calculating ensemble average 
weight enumerators have been presented in [7] and [9]. We 
now briefly describe the methods presented in [7]. 

A. Ensemble weight enumerators 

Suppose a protograph contains m variable nodes to be 
transmitted over the channel and Uy — m punctured vari- 
able nodes. Also, suppose that each of the m transmitted 
variable nodes has an associated weight di G {0, 1}. Let 
Sd = {(<^i,<^2, • • • ,<^m)} be the set of all possible weight 
distributions such that di -\- . . . -\- dm = d, and let Sp be the set 
of all possible weight distributions for the remaining punctured 
nodes. The ensemble weight enumerator for the protograph is 
then given by 



{dk}^Sd {djjeSp 



(3) 



where A^ is the average number of codewords in the ensemble 
with a particular weight distribution d = (di, (i2, • • • , <^n^)- 

B. Asymptotic weight enumerators 

The normalized logarithmic asymptotic weight distribu- 
tion of a code ensemble can be written as r{6) = 
limn^cx)Sup rn{S), where rn{S) = ^^^^^, S = d/n, d is 
the Hamming weight, n is the block length, and A^ is the 
ensemble average weight distribution. 

Suppose the first zero crossing of r{S) occurs at S = Smin- 
If r{6) is negative in the range < ^ < Smin^ then 6min is 
called the minimum distance growth rate of the code ensemble. 
By considering the probability 
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it is clear that, as the block length n grows, if F{d < 
^min^) << 1, then we can say with high probability that the 
majority of codes in the ensemble have a minimum distance 
that grows linearly with n and that the distance growth rate is 



where we note that, since the row and column weights of 
P are not constant, P represents the parity-check matrix of 
an irregular LDPC code. For a (J^K) regular LDPC code, 
the protograph contains ric = J check nodes and Uy = K 
variable nodes, where each variable node is connected to all 
J check nodes, i.e., P is an "all-one" matri^j. The sparsity 
condition of an LDPC parity-check matrix is thus satisfied for 
large TV. The code created by applying the copy-and-permute 
operation to an ric x ^v protograph parity-check matrix P has 
block length n = Nuy. In addition, the code has the same 

^It is also possible to consider protograph parity-check matrices P with 
larger integer entries, which represent parallel edges in the the base proto- 
graph. In this case, the corresponding block in H consists of a sum ofNxN 
permutation matrices. See [8] for details. 



IV. Forming Convolutional Codes from 
Protographs 

In this section, we present methods to form convolutional 
parity-check matrices from the parity-check matrix of a pro- 
tograph. 

A. Unwrapping a protograph with gcd{nc, Uy) > 1 

Suppose that we have an ric x ^v protograph parity-check 
matrix P, where gcd(nc,n^) = y > 1. We then partition P 
SiS Si y X y block matrix as follows: 

Pl,l • • • Pl,y 
P = 



where each block Pij is of size ric/y x Uy/y. P can now 
be separated into a lower triangular part, Pi, and an upper 
triangular part minus the leading diagonal, Pu. Explicitly, 



Pi = 
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^2,1 ^2,2 



_ Py,l Py,2 . . • Py 



and 
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where blank spaces correspond to zeros. This operation is 
called 'cutting' a protograph parity-check matrix. 

Rearranging the positions of these two triangular matrices 
and repeating them indefinitely results in a parity-check matrix 
Hcc of an unterminated, periodically time-varying convolu- 
tional code with decoding constraint length u^ = Uy and period 
T = Uy given by 
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(4) 



Note that the unwrapping procedure described above preserves 
the row and column weights of the protograph parity-check 
matrix. 



B. Unwrapping a protograph with gcd{nc^ Uy) = 1 

If gcd(nc, riy) = 1, we cannot form a square block matrix 
larger than 1x1 with equal size blocks. In this case. Pi = P 
and Pu is the all zero matrix of size ric x Uy. This trivial cut 
results in a convolutional code with syndrome former memory 
zero, with repeating blocks of the original protograph on the 
leading diagonal. We now propose two methods of dealing 
with this structure. 

1) Form an M -cover: Here, we create a larger protograph 
parity-check matrix by using the copy and permute operation 
on P. This results in an Mric x Muy = n'^ x n^ parity-check 
matrix for some small integer M. The n'^ x n^ protograph 
parity-check matrix can then be cut following the procedure 
outlined above. In effect, the M x M permutation matrix 
creates a mini ensemble of block codes that can be be 
unwrapped to an ensemble of convolutional codes. The re- 
sulting unterminated, periodically time-varying convolutional 
code has decoding constraint length v^ = Muy and period 

T = MUy. 



2) Use a nonuniform cut: When gcd(nc,n^) = 1, we can 
still form a convolutional code by unwrapping the protograph 
parity-check matrix using a nonuniform cut. Let the protograph 
parity-check matrix be written as 
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We define a vector ^ consisting of Uc step parameters ^ = 
(6,6, • • • , 6c)' where < 6 < 6c < ^v, and each ^i_i < 
6 for i = 2, ..., nc . As in the previous case, we form ric x Uy 
matrices Pi and Pu as follows 

• for each ^i, i = 1, . . . ,nc, the entries pi^i to pi^^. are 
copied into the equivalent positions in Pi ; 

• entries Pi,^i+i to pi^n^ are copied, if they exist, into the 
equivalent positions in Pu ; 

• the remaining positions in Pi and Pu are set to zero. 

We now form the parity-check matrix Hcc of an untermi- 
nated, periodically time- varying convolutional code as in dU. 
Nonuniform cuts do not change the row and column weights 
of the parity-check matrix P. Further, the decoding constraint 
length remains constant. 

An LDPC convolutional code derived from an LDPC block 
code using a nonuniform cut can be encoded and decoded 
using conventional encoding and decoding methods with mi- 
nor modifications. For an LDPC convolutional code obtained 
using the nonuniform cut ^ = {(.i, - - - ^(.nj^ the maximum 
step width (,rnax for the cut is given by 
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max = max {6,6 

i=2,...,nc 
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^max — 6 columns of zeros are then appended immediately 
to the left of the columns in the original protograph parity- 
check matrix P corresponding to the steps 6. ^ = 1, 2, . . . , nc, 
to form a modified protograph parity-check matrix P^ This 
process is demonstrated for a (3, 4)-regular protograph with the 
nonuniform cut (f = (2, 3, 4) below: 
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LDPC convolutional codes unwrapped from P^ can be en- 
coded by a conventional LDPC convolutional encoder with the 
condition that information symbols are not assigned to the all- 
zero columns. Thus, these columns correspond to punctured 
symbols, and the code rate is not affected. At the decoder, 
a conventional pipeline decoder can be employed to decode 
the received sequence. No special treatment is necessary for 
the symbols corresponding to the all-zero columns, since the 
column weight of zero insures that they are not included in any 
parity-check equations, i.e., the belief-propagation decoding 
algorithm ignores the corresponding symbols. 



V. Free distance bounds 

We now introduce the notion of tail-biting convolutional 
codes by defining an 'unwrapping factor' A as the number 
of times the sHding convolutional structure is repeated. For 
A > 1, the parity-check matrix H^^ ^ of the desired tail-biting 
convolutional code can be written as 
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Note that the tail-biting convolutional code for A = 1 is simply 
the original block code. 

A. A tail-biting LDPC convolutional code ensemble 

Given a protograph parity-check matrix P, we generate 
a family of tail-biting convolutional codes with increasing 
block lengths An^, A = 1,2,..., using the process described 
above. Since tail-biting convolutional codes are themselves 
block codes, we can treat the Tanner graph of H^^ ^ as a 
protograph for each value of A. Replacing the entries of this 
matrix with either N x N permutation matrices or N x N all 
zero matrices, as discussed in Section [nil creates an ensemble 
of LDPC codes with block length n = XNuy that can be 
analyzed asymptotically as N goes to infinity, where the 
sparsity condition of an LDPC code is satisfied for large 
A^. Each tail-biting LDPC code ensemble, in turn, can be 
unwrapped and repeated indefinitely to form an ensemble of 
unterminated, periodically time-varying LDPC convolutional 
codes with decoding constraint length Us = Nriy and period 

T = XNUy. 

Intuitively, as A increases, the tail-biting code becomes a 
better representation of the associated unterminated convolu- 
tional code, with A ^ oo corresponding to the unterminated 
convolutional code itself. This is reflected in the weight 
enumerators, and it is shown in Section |Vll that increasing A 
provides us with distance growth rates that converge to a lower 
bound on the free distance growth rate of the unterminated 
convolutional code. 

B. A free distance bound 

Tail-biting convolutional codes can be used to establish 
a lower bound on the free distance of an associated un- 
terminated, periodically time-varying convolutional code by 
showing that the free distance of the unterminated code is 
lower bounded by the minimum distance of any of its tail- 
biting versions. 

Theorem 1: Consider a rate R = {uy — nc)/ny unter- 
minated, periodically time-varying convolutional code with 
decoding constraint length u^ = Nuy and period T = XNuy. 
Let dmin be the minimum distance of the associated tail-biting 
convolutional code with length n = XNuy and unwrapping 



factor A > 0. Then the free distance dfree of the untermi- 
nated convolutional code is lower bounded by dmin for any 
unwrapping factor A, i.e., 

dfree > dmin^ VA > 0. (5) 

Sketch of proof It can be shown that any codeword in 
a rate R = {uy — nc)/ny unterminated, periodically time- 
varying convolutional code with constraint length v^ = Nuy 
and period T = XNriy can be wrapped back to a codeword in 
a tail-biting convolutional code of length n = XNuy , for any 
A. The 'wrapping back' procedure consists of dividing the 
convolutional codeword into segments of length XNuy and 
superimposing these segments through a modulo summation. 
The Hamming weight of the resulting codeword in the tail- 
biting code must be equal to or less than that of the codeword 
in the unterminated code. The result is then obtained by 
wrapping back the unterminated codeword with minimum 
Hamming weight. For a formal proof, see [6]. 

A trivial corollary of the above theorem is that the minimum 
distance of a protograph-based LDPC block code is a lower 
bound on the free distance of the associated unterminated, 
periodically time- varying LDPC convolutional code. This can 
be observed by setting A = 1. 

C. The free distance growth rate 

The distance growth rate Smin of a block code ensemble is 
defined as its minimum distance to block length ratio. For 
the protograph-based tail-biting LDPC convolutional codes 
defined in Section IV-AI this ratio is therefore given as 
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Using ([5]) we obtain 
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where dfree is the free distance of the associated unterminated, 
periodically time- varying LDPC convolutional code. It is im- 
portant to note that, for convolutional codes, the length of the 
shortest codeword is equal to the encoding constraint length Vq, 
which in general differs from the decoding constraint length 
Us' Assuming minimal encoder and syndrome former matrices, 
the relation between Vq and v^ can be expressed as 

1-R 



R 



(8) 



which implies that, for code rates less than 1/2, the encoding 
constraint length is larger than the decoding constraint length. 
Combining (|7]) and ([8]) gives us the desired bound on the 
free distance growth rate 



'^ free 



> -^XS. 



(9) 



1-R 

where Sfree_= dfree /^e IS the convolutional code free distance 
growth rateEl- 

^If the syndrome former matrix is not in minimal form, ([Sj results in an 
upper bound on Ue, which implies that 6 free is underestimated in this case. 



VI. Bound computations 

We now present free distance growth rate results for en- 
sembles of asymptotically good, regular, LDPC convolutional 
codes based on protographs. We consider all the regular 
ensembles originally considered by Gallager [10], and for 
each we calculate a lower bound on the free distance to 
constraint length ratio 6 free- We begin by considering the 
regular ensembles with gcd(nc,n^) > 1. Then we consider 
the methods proposed in Section IIV-BI for regular ensembles 
with gcd(nc,n^) = 1. Results for these ensembles are then 
presented and discussed. 

A. Regular Ensembles with gcd{nc^ny) > 1 

Example 1: Consider the rate R = 1/2, (3, 6)-regular LDPC 
code ensemble based on the following protograph: 




For this example, the minimum distance growth rate is 5min = 
0.023, as originally computed by Gallager [10]. A family of 
tail-biting (3, 6) -regular LDPC convolutional code ensembles 
can be generated according to the following cut: 
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For A = 2, 3, . . . , 8, the minimum distance growth rate 5min 
was calculated for the tail-biting LDPC convolutional code 
ensembles using the approach outlined in Section IV-A[ These 
growth rates are shown in Fig. [21 along with the corresponding 
lower bound on the free distance growth rate 5 free of the as- 
sociated ensemble of unterminated, periodically time- varying 
LDPC convolutional codes. For this rate R = 1/2 ensemble, 
the lower bound on 5 free is simply 5 free ^ 
A(5min, since j^ = 1 in this case. 



-R i^'^i^ 




Lower bound on the convolutional 
growth rate 5 



Tail-biting growth rates 6 



3 4 5 6 

Protograph unwrapping factor A 



We observe that, once the unwrapping factor A of the tail- 
biting convolutional codes exceeds 3, the lower bound on Sfree 
levels off at Sfree > 0.086, which agrees with the results 
presented in [5] and [6] and represents a significant increase 
over the value of Smin- In this case, the minimum weight 
codeword in the unterminated convolutional code also appears 
as a codeword in the tail-biting cod^j. 

Example 2: Consider the rate i? = 1/3, (4, 6) -regular LDPC 
code ensemble. The minimum distance growth rate for this 
ensemble is Smin = 0.128 [10]. We form a protograph in the 
usual fashion, creating 4 check nodes, each of which connect 
to all 6 variable nodes, and we observe that gcd(4, 6) = 2. The 
protograph parity-check matrix and defined cut are displayed 
below: 
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For this rate R = 1/3 ensemble, the lower bound on Sfree 
is Sfree ^ j^^Smin = ^^Smin- We obscrvc that, as in 
Example 1, the minimum distance growth rates calculated for 
increasing A provide us with a lower bound Sfree > 0.197 
on the free distance growth rate of the convolutional code 
ensemble, which exceeds the value of Smin- 

Example 3: Consider the rate i? = 1/2, (4, 8) -regular LDPC 
code ensemble. The minimum distance growth rate for this 
ensemble is Smin = 0.063 [10]. The protograph parity-check 
matrix is cut along the diagonal in steps of 1 x 2. For this 
rate R = 1/2 ensemble, the lower bound on Sfree is Sfree ^ 



l_^^^nnin 



XSr, 



and we obtain the lower bound S 



free 



> 



0.191 on the free distance growth rate of the convolutional 
code ensemble, which is again significantly larger than Smin- 

B. Regular Ensembles with gcd{nc^ Uy) = 1 

We now present results for the two methods of unwrapping 
a protograph with gcd(nc, Uy) = 1 introduced in Section HV-B I 

Example 4: Consider the rate R = 2/5, (3, 5) -regular en- 
semble. The minimum distance growth rate for this ensemble 
is Smin = 0.045 [10]. For this rate R = 2/5 ensemble, the 

lower bound on Sfree is Sfree > J^^Smin = l>^Smin- 

The first approach was to form a two-cover of the regular 
protograph. The resulting mini-ensemble has 2^^^^ = 2^^ 
members. Fifty distinct members were chosen randomly. The 
resulting lower bounds calculated for Sfree are shown in a box 
plot in Fig. [3] 

We observe a fairly large spread in results from the mini- 
ensemble. The median from the fifty trials is Sfree = 0.097. 
We also observe that the smallest lower bound found is 
statistically a outlier as it lies reasonably far away from the 
lower quartile. Note that this smallest lower bound (Sfree > 
0.069) is larger than the block code growth rate Smin = 0.045. 
Also, the best lower bound, Sfree ^ 0.108, is significantly 
larger than Smin- 



Fig. 2. Distance growth rates for Example 1. 



^Example 1 was previously presented in [11], 
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Fig. 3. Free distance growth rates for 50 mini-ensemble members. 



We now consider the nonuniform cut case. Consider the 
following two nonuniform cuts of the standard protograph 
parity-check matrix for the regular (3,5) ensemble: 



and P: 



with corresponding cutting vectors ^i = (2, 4, 5) and ^2 = 
(1,2,3). We calculate a lower bound of Sfree > 0.119 for cut 
one and 5 free ^ 0.111 for cut two. Both nonuniform cuts give 
larger lower bounds on Sfree than the mini-ensemble method. 
For the remaining regular ensembles with gcd(nc, riy) = 1, 
we used the nonuniform cut method. The resulting bounds are 
given in the table below. 



"1 


1 
1 
1 


1 


1 1" 


1 

1 


1 

1 


1 1 




Ensemble 



(3,4) 
(4,5) 
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0.112 
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0.254 



Lower bound on S 



free 
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0.317 



For each ensemble considered, the lower bound on Sfree is 
significantly larger than Smin for the block code ensemble. 
This is illustrated in Fig. IH where the distance growth rates 
of each regular LDPC code ensemble are compared to the 
corresponding bounds for general block and convolutional 
codes. 

VII. Conclusions 

In this paper, asymptotic methods were used to calculate 
a lower bound on free distance that grows linearly with con- 
straint length for several ensembles of regular, unterminated, 
protograph-based periodically time-varying LDPC convolu- 
tional codes. It was shown that the free distance growth rates 
of the regular LDPC convolutional code ensembles exceed the 
minimum distance growth rates of the corresponding regular 
LDPC block code ensembles. When gcd(nc,n^) = 1, we 
proposed two new methods of unwrapping the protograph 
parity-check matrix in order to obtain the best possible lower 
bound on Sfree- The results suggest that we typically obtain 
better lower bounds by performing nonuniform cuts. 



Fig. 4. Comparison of calculated growth rates with the Gilbert-Varshamov 
bound for block code minimum distance growth rates and the Costello bound 
for convolutional code free distance growth rates. 
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